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Abstract. Consider an n x n non-Hermitian random matrix M„ whose en- 
tries are independent real random variables. Under suitable conditions on the 
entries, we study the fluctuations of the entries of f{Mn) as n tends to infinity, 
where / is analytic on an appropriate domain. This extends the results in I19| . 
|20) . and [23] from symmetric random matrices to the non-Hermitian case. 



1. Introduction and Main Results 

There have been a number of resuhs recently concerning matrix entries of func- 
tions of random matrices. The resuhs so far have deah with symmetric (Hermitian) 
random matrix ensembles. That is, for a n x n real symmetric (Hermitian) random 
matrix, M„, one studies the entries of the matrix /(M„) where / is a regular test 
function. 

For a symmetric (Hermitian) matrix Af„, we define f{M„) using functional cal- 
culus. That is, if M„ is diagonalized as Af„ — V*DV where V is an orthogonal (uni- 
tary) matrix and D is diagonal, then /(M„) is constructed as /(M„) = V* f{D)V 
where f{D) is again a diagonal matrix with the entries /{Da) on the diagonal. 

In [16] , Lytova and Pastur consider the case where M„ is drawn from the Gauss- 
ian Orthogonal Ensemble (GOE) or Gaussian Unitary Ensemble (GUE). The more 
general case where M„ is a symmetric (Hermitian) Wigner matrix with i.i.d. entries 
(not necessarily Gaussian) was studied by Pizzo, Renfrew, and Soshnikov in [23] 
and by Pastur and Lytova in [22] . 

The results of [53] and [35] are extended in [19j to the case where M„ is a 
Wigner matrix with independent but not necessarily identically distributed entries. 
The authors require that the off-diagonal entries have uniformly bounded fourth 
moments, diagonal entries have uniformly bounded second moments, and certain 
Lindeberg type conditions for both the off-diagonal entries and the diagonal entries 
are satisfied. The test function f{x) is assumed to satisfy 



(l + 2|fc|)2^|/(fc)pdfc< 



for some s > 3 where / is the Fourier transform 



'2-n 

Under these conditions it is shown in 19 that 

(1) V^f/I^^y -E/(^^y j -a(/)(M„),, ^7V(0,d2(/)), 
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as rt — > oo, where a{f) and d?{f) are given constants depending on the function /. 

Recently, similar results were obtained in [20 for the sample covariance case 
where M„ = AnA*j^ and An is an n x TV random matrix with independent entries 
under analogous moment and Lindeberg type conditions on the entries of An- 

Instead of considering a specific entry of f{Mn), Bai and Pan in [6 study the 
fluctuations of u* f {Mn)u when Af„ is a Wigner matrix whose entries satisfy some 
moment assumptions, / is an analytic function, and u is a delocalized unit vector. 

In this paper, we consider non-Hermitian random matrices with independent en- 
tries. Given a n x n random matrix M„ , we define the empirical spectral distribution 



where Ai, . . . , A„ are the eigenvalues of A/„. 

The ESD for non-Hermitian random matrices with i.i.d. Gaussian entries was 
first studied by Mehta [T7]. In particular, in the case where the entries of Af„ are 
i.i.d. standard complex normal random variables, the ESD of -^Mn converges, as 
n — )■ cx), to the circular law Fc given by 



In other words, Fc is the uniform distribution over the unit disk in the complex 
plane. 

Mehta used the joint density function of the eigenvalues of -^Mn which was 
derived by Ginibre [TT]. The real Gaussian case was studied by Edelman in [lOj . 
For the general (non- Gaussian) case when there is no formula, the problem appears 
much more difficult. Important results were obtained by Girko [121 E], Bai OH], 
and more recently by Gotze and Tikhomirov [M], Pan and Zhou [21], and Tao 
and Vu [26j . These results confirm the same limiting law under some moment or 
smoothness assumptions on the distribution of the entries. Recently, Tao and Vu 
(appendix by Krishnapur) were able to remove all these additional assumptions, 
establishing the law under the first two moments [2^. 

Theorem 1 (Circular law for non-Hermitian i.i.d. matrices; |27j). Assume that 
the entries of the nx n matrix Mn are i.i.d. copies of a complex random variable of 
mean zero and variance one. Then the ESD of the matrix -^M^ converges almost 
surely to Fc as n ^ oo. 

Theorem [1] also holds for random matrices with independent but not necessarily 
identically distributed entries, provided one has some uniform control of the entries 
(see Appendix C of [27 ). 

When Mn is a non-Hermitian matrix and / is analytic, we define f{Mn) as 



(ESD), F*^", of M„ to be 



F*^"(a;,y) := -#{1 < ] < n : Re(A,) < a;,Im(A,) < y), 



Fc{x, y) :— — mes ( |2;| < 1 : Ke{z) < x, Im(2) < y 



oo 




/(M„) = ^/W(0) 



k\ 




< oo. 



where || • || denotes the spectral norm. 
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In [25j , Rider and Silverstein study linear eigenvalue statistics of non-Hermitian 
random matrices with i.i.d. entries. Let / be analytic in a neighborhood of the 
disk {z € C : \z\ < 4}. It is shown in gS] that 

(2) tr -"/(O) 

converges to a mean zero complex Gaussian as the size of the matrix tends to 
infinity, provided the distribution of the complex entries of M„ satisfy some moment 
and smoothness assumptions. The real case was studied in |18) under a different 
set of assumptions on the entries of M„ in the case when / is a polynomial. 

The goal of this paper is to prove the analogue of ([T]) in the case that M„ is a 
non-Hermitian random matrix with independent entries. In particular, we consider 
the following ensemble of non-Hermitian random matrices. 

Definition 2. For each n > 1, let M„ — {ninij) he a n x n real random matrix. 
The sequence of random matrices {M„}„>i is said to satisfy condition CO if the 
following conditions hold: 

(i) For each n > 1, {mnij : 1 < j,j < is a collection of independent real 
random variables with mean zero and variance one, 

(ii) sup„_,_jE|m„ij|4 < oo, 



(iii) For all e > 0, 



E 



Elm 



,-|>eV"} 



as n — >■ oo. 

Remark 3. For each n > 1, let M„ be an n x n matrix whose entries are i.i.d. 
copies of a real random variable ^. Then the sequence {Af„}„>i satisifies condition 
CO if ^ has mean zero, unit variance, and E[^^] = 7714 < 00. 

For each n > 1, let M„ = {rrinij) be a n x n real random matrix and assume the 
sequence of random matrices {M„}n>i satisfies condition CO. Let / be analytic in 
a region that contains the disk {z G C : |z| < 2 + e} for some e > 0. In our main 
result below, we show that for any fixed indices i and j, the entry 

(3) /f^^^") -/(0)<5.,-/'(0)^m„, 

converges in distribution to a complex Gaussian random variable as n tends to 
infinity, where Sij denotes the Kronecker delta. The appearance of /(O) is not 
surprising considering ([2]) and since /(O) is the average of / against the circular 
law. That is, 

- / f{z)d'z = /(O) 

J{z:\z\<l} 

because / is analytic. The /'(O) term in ^ is analogous to the a{f) term which 
appears in ([1]). 

Theorem 4. For each n> 1, let Af„ be an n x n real random matrix and assume 
the sequence {M„}„>i satisfies condition CO. Fix I > 1 and assume that for each 
1 < i < I and every S > 0, 



(4) 



1 " 



"^nijl{|m„i3|>5ni/4} 



^nji'^{\m„ji\>5nUi} 
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as n —> oo . Then the following holds: 
(i) if f is analytic in a region that contains the disk {z €E C : [zj < 2 + e} for 
some e > 0, the normalized matrix entries 



1 



1 



^\f[—MA ^ f{Q)S,,^ f{Q)—m 



are independent in the limit n — >■ oo, 
(ii) if f I, ... , fm are analytic in a region that contains the disk {z G C : |z| < 2 + e} 
for some e > and 1 < i, j < I are fixed, the random m-vector 



1 



fk{0)S^J - /fc(0)— =m„y 



^1 ' / fe=i 

converges in distribution to the mean zero multivariate complex Gaussian 
{Z{fi), . . . , Z{f„i)) as n ^ oo defined by 



(5) 



r=2 



Remark 5. We draw the reader's attention to one special case of Theorem S) 
Consider the monomial f{z) ~ z* for some integer t>l. In this case, the limiting 
distribution Z{f) is standard Gaussian. Moreover, if f[z) — z*, g{z) = z* for 
integers s,t > 1 with s ^ t, then (O implies that the limiting distributions Z[f) 
and Z{g) are independent. 

Theorem 3] is a corollary of Theorem IH] below in which we study the entries of 
the resolvent 



z/„ 



1 



1 



where /„ is the identity matrix of order n. The result can be extended from the 
resolvent case to arbitrary analytic functions by using Cauchy's integral formula. 

Below and throughout the paper, we use \ for the imaginary unit and reserve 
i for an index. 

Theorem 6. For each n> 1, let M„ he an n x n real random matrix and assume 
the sequence {M„}„>i satisfies condition CO. Fix I > 1 and assume that for each 
1 < i < I and all S > ^ holds as n oo. Define the I x / matrix 

-I I 



(6) 



Yniz) 



1 



--Mr 



1 



Let D d C be any compact set outside the disk {z € C : |z| < 2 + e} for some e > 0. 
Define 

I 



-A: 



where aij, Pij G C for 1 < i, j < I. Then {Sn}n>i is tight in the .space of continuous 
functions on D and converges weakly to the complex Gaussian process 
I 



S{z) 



r(z),, + y(z). 
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where Y{z) — {Y{z)ij}\ .j^i is the matrix valued complex Gaussian process defined 
by 

^ z^w^ zw -1 

andE[Y{z)ij] ^ 0. 

In addition, for any finite s > 1, the entries Yn{zk)ik.jk, ^ ^ ^k, jk ^ h ^ ^ k l£ s, 
zi, . . . , Zs (z D are independent provided Ji), (■*2, J2), ■ • • , (*s, Js) ire distinct. 

The fact that Theorem [5] is stated for D outside the disk {z e C : |z| < 2 + e} 
(and Theorem 2] is stated for functions analytic in a region containing {z G C : 
\z\ < 2 + e}) requires some explanation. For simplicity, assume for each n > I, Mn 
is a n X n real random matrix whose entries are i.i.d. copies of a random variable 
with mean zero, unit variance, and finite fourth moment. Since the spectral radius 
of -^Mn converges to 1 in probability as n tends to infinity fT, Theorem 5.18], 
it is natural to conjecture that Theorem [6] should hold for D outside the disk 
{z e C : \z\ < 1 + e} (and Theorem |4] should hold for / analytic in a region 
containing {z £ C : \z\ < 1 + e}). 

In order to prove Theorem|6l we need to ensure that zln-'-^Mn is invertible and 
obtain control of the resolvent. Since the spectral radius converges to 1, it is natural 
to work on the event that the spectral radius is less than 1 + e/2. However, in the 
proof of Theorem [6l we must also consider the matrix Mn^i, which is constructed 
from the matrix M„ by removing the first I columns and I rows. The problem that 
arises is that control of the spectral radius of Af„ does not imply that we have 
similar control of the spectral radius of Mn.i- On the other hand, ||M„_i|| < ||M„||. 
Thus we must deal with the spectral norm instead of the spectral radius. Since 
-^||M„|| converges in probability to 2 as n — >■ 00 (see Lemma [8] below) , we have 
uniform control of the resolvent if we take \z\ > 2. This statement is made precise 
in Proposition [TTJ 

The paper is organized as follows. In Section [2l we state our preliminary tools 
and prove Theorem [4] The proof of Theorem [6] is divided into two parts and 
presented in Sections [3] and 21 

2. Overview and Preliminary Tools 

In this section, we introduce some standard notation and present our preliminary 
tools. 

Throughout this paper, n is an asymptotic parameter going to infinity. We use 
0(1) to denote any quantity that is bounded in magnitude by an expression that 
converges to zero as n tends to infinity We use X — 0{Y) to denote the estimate 
\X\ < CY where the implied constant C is independent of n. We use C throughout 
the paper to denote some positive constant which does not depend on n that may 
change from line to line. 

We note that by condition fm)) from Definition [21 it follows that there exists a 
sequence e„ — >■ such that 

n 

as n — 00. 

We then have the following standard truncation lemma which can be found in 

m- 
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Lemma 7. Assume that for each n > 1, Mn is an nxn real random matrix and the 
sequence {Af„}„>i satisifies condition CO. Fix I > 1 and write [I] — {1,2,...,/}. 
Assume that for each i £ [I] and for every 6 > 0, ^ holds as n oo. Then there 
exists a sequence {M„}„>i where Mn is a n x n matrix with independent entries 
and there exists a sequence e„ which tends to zero as n tends to infinity such that 

(i) the entries {Mn)jk have mean zero and variance one, 

(li) sn^j^km ^ '^«%/^' 

(lii) supi<j<„ ,g[,] |(M„),j| < e„ni/4, 

(iv) supi<j<„ ,g[,] |(M„)j-,| < tnn^/^, 

(v) sup„ ,,E|(M„)jfc|'^ < oo, 

(vi) P(M„ ^ Mn) — > Q as n ^ oo. 

Using [31 Theorem 5.9] and Lemma [71 we obtain the following bound on the 
spectral norm of M„. 

Lemma 8. For each n > 1, let Mn he an n x n real random matrix and assume 
the sequence {Mn}n>i satisfies condition CO. Then 

lim sup 

n— fCJO 

in probability. 

Assume Theorem [6l for the moment. We are now ready prove Theorem [H 



Mn 



< 2 



Proof of Theorem [^J Fix e > and let 7 be the circle of radius 2 + e centered 
around the origin. Let D be a compact set outside the disk {z £ C : \z\ < 2 + e/2} 
that contains 7. Suppose / is analytic in a disk about the origin that contains the 
contour 7. By Lemma [51 and Cauchy's integral formula, we have, with probability 
going to one, that 



( / ( -^Mnj - f{Q)S,j - /'(0)-^m„, 




f{z)Yn{z)ijdz 



for 1 < i,j < Z. To study the joint distribution of the l^ entries, we use the 
Cramer- Wold device and study random variables of the form 



(7) 



1 



27rV^ 



{fi{z) + --- + fk{z))Sn{z)dz, 



where /i , . . . , are analytic in a region about the origin that contains the contour 
7. By Thereom ini Sn{z) converges weakly to S{z) in the space of continuous 
functions on D. Therefore the random variable in ([T]) converges in distribution to a 
Gaussian random variable with mean zero as n tends to infinity. We now compute 
the limiting covariances. Since S{z) is a linear combination of the entries of Y{z), 
it suffices to study the entries of Y{z). For functions / and g analytic in a region 
that contains the contour 7, the limiting covariance is given by 



E[Z(/)Z(.g)] = E 




f{z)Y(z)ijdz 



1 



27r 



f{w)Y{w)ijdw 
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Using Fubini's theorem, we can rewrite the hmiting covariance as 

2 



nz{.f)Z{g)] 



f{z)g{w)¥.[Y{z),jY{w)^j]dzdw 



-dzdw 



1 



E 



/^(O) 3W(0) 



Since E[Y{z)i,j,Y{w) 

^2,32] — 7^ (*2,j2) by Theorem [5] and since the 

joint hmiting distribution is Gaussian, it follows that the normalized entries 



1 



1 



/(0)% - /'(0)^m 



1 < i.i < I 



are independent in the limit n — > 00. The proof of Theorem |4] is complete. 



□ 



We now turn our attention to proving Theorem |51 We will continue to use the 
notation to denote the spectral norm of the matrix B. We will also make use 
of the following lemmas. 

Lemma 9. Let u„ and v„ be independent n-vectors whose entries are independent 
random variables with mean zero and variance one. Let i?„ be an independent nxn 
random matrix where \\B\\ < a for all n. Then 

2 



E 



1 



= ^ETr (BB^) < 
n 



Proof. The inequality is trivial and follows from the assumption < a. We 
denote the entries of u„ = v„ = (wfe)^^i, and B = {Bij)^^^-^. Then by the 

independence of -B, u„, and v„, we have that 

2 



E 



1 



EujBjkVkUiBi 



j,k,l.m—l 



iB' = -ETr{BB'). 
•' n 



□ 



Lemma 10. For each n > 1, let x„ = {xni)f^i be a real n-vector and let Bn = 
itinij)i'j^i be an independent nxn random matrix. Assume that 

(i) The entries of are independent and have mean zero and variance 1, 

(ii) sup„ j E|a;„i|"' < 7714 < 00, 

(Hi) There exists a sequence e„ — > such that \xni\ < tn\pn. for all n > 1 ana 
1 < i < n, 

(iv) There exists a constant a (not depending on n) such that \\B\\ < a. 
Then there exists an absolute constant C > such that 
(^) E|ixTx„-l|4<c[Hi^ + 2|", 

(ii) E|ixTi3„x„ - itr(B„)|4 < Ca^mi + 

(iii) For any fixed index k, El^eJS^.Xnl" < C [a*'^^^] , 
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(w) For any fixed mdex k, E|^xTB„efe|4 < C [a'*^^^] ■ 

Proof. To prove we note that 
1 " 



. . . . 

Jl J2 J3 J4 = l 



By the independence of the entries of x„, ¥,[{x'^j^-\){x\j^ - l)(2:^j3 - = 
when any ji is distinct from the other three indices. So we have two cases that 
give non- vanishing expectation: 

(1) When ii = i2 = js = ii, we have that 

i=i 

(2) For ji = ji and = jt with jg ^ ji, there are 3 arrangements of such 
pairings. For each pairing, we have that 



Thus, we have that 

E|-xTx„-l|'* <C 



m4e„ m| 



n 

Statement ^ fohows from Lemma B.26 in ^ (taking p = 4) by conditioning on 
the entries of Bn since i?„ and independent. 
To prove statement fiii)) . we write 



1 1 " 



^nkj2'^nj2-^nkj3-^njsBnkj4-^nj4\ 
^ " ilj2j3j4 = l 

As in the proof of statement ^ , we use the independence of the entries and consider 
two distinct cases when the expectation of the summand is non-zero. The cases 
are: 

(1) When ji = j2 = js = j4, we have that 

, n 4 

-i^E[|S„,,|V„,.] < '^a'(B^B:U < 
n .^^ n n 

(2) For ji — ji and js = jt with js ^ ji, there are 3 arrangements of such 
pairings. In each pairing we obtain 

1 1 

Combining the two bounds above completes the proof of statement The 
proof of statement ([iv| foUows the same argument. □ 

For the remainder of the paper, we fix / > 1, e > 0, and a compact set D d C 
outside the disk {z g C : |z| < 2 + e}. 

We write the matrix M„ as a block matrix in the following way: let X be the 
upper-left / x / block of M„, let Mnj be the lower-right [n — I) x {n — I) block of 
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Mn, let (p be the lower- left {n — I) x I block of Mn, and let ip be the upper- right 
I X {n — I) block. That is, 

'X ip 

Since the entries of M„ are independent, X, Mn.i, 0, and "0 are independent. 
We write the resolvent of A/„ as 

-1 



Rn{z) : 

and write the resolvent of Mn.i as 



1 



1 



Rn.iiz) := \ z--=M.n. 

In order to work with Rn{z) (or Rn.i{z)) we will need a priori control of the 
norm ||i?„(z)|| (||_R„ ;(z)||). Following Rider and Silverstein in [2S], we define the 
event 

1 



\M„\\ < K 



where we fix the value 2 < k < 2 + e/2. Then for \z\ > 2 + e, there exists a constant 
/C = /C(k, e) such that 

sup ||i?„(2:)|| < /C on the event f7„. 

\z\>2+e 



Indeed, for ^||Af„|| <k<2 + e/2. 



\\Rniz)\\ 



In- 



--Mr, 



Z\^n 



< 



' I k=0 



M„ 



z\/n 



fe=0 



2 + e/2 



provided \z\ > 2 + e. 

We now assume both k and JC are fixed and restate the above result in the 
following proposition. 

Proposition 11. //-^||M„|| < k, then sup|_j|>2+e ll^nl-^:)!! < A^^- 

By the contrapositive of Proposition llli if sup^g ^ \\Rniz)\\ >/C,then^||Af„|| > 
K. Thus, 

pfsup||i?„(z)|| >ic] <p{n^)^o 

\zeD J 

as n — >■ oo by Lemma [8l 

Therefore, when we work with the resolvent i?„(z), we will always work on the 
event that sup^g^ ||i?„(z)|| is finite. For the remainder of the paper, we will assume 

z e D. 

We also define the event 

= |m„ : ^||Af„,|| <k\ 



In particular, if ||Af„|| < k then ||Af„^i|| < k and hence C ^n,i- Equivalently, we 
write ln„ < ln„ , where In denotes the indicator function of the event fi. 

We divide the proof of TheoremlHlinto two parts. In Section[31 we prove the finite 
dimensional distributions of 5„(z) converge to S(z). We then show that {S'„}„>i 
is tight in the space of continuous functions on D in Section 01 
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3. Convergence of the Finite Dimensional Distributions 



In this section, we show that the finite dimensional distributions of Sn{z) con- 
verge to S{z). To study the entries of the resolvent we apply the standard formula 
for the inverse of a partitioned matrix (see for instance |15]). In particular, we 
obtain 



z ]=X - -tpRn,l{z)(l)] lo„ 

Wn n ' 



-^X + -^ljR,,^i{z)(j) 
^ y/n n 

with probability going to one. 

It will follow from the discussion below and from Lemma [9] that 

,-1/2 



\\X\\ + \\n-'^'^R„j{z)cj)\\U 



is bounded in probability. Thus, we have that 



Yn(z)ln„^, = 



-ipR„,i{z)(t> 
n 



+0(1) 



in probability. 

By Proposition [TTl 



(\\Y4z)\\lno ^ > ri) <P(r!,';^,,)+pfsup||i?„(z)|| >/C 
^ ^ \zeD 



as n — )■ oo. Thus 



-tpRn,l{z)(l) 



0(1) 



in probability. 

We now apply Lemma [T] Let M„ be the truncated matrix in Lemma [7] and 
define X, Mn,i, <t', V' to be the appropriate blocks of M„. Since M„ and M„ agree 
with probability going to 1, we have that 



-lijRn,l{z) 

n 



0(1) 



in probability. 

Our goal is to apply Lemma [14] from Appendix [K\ to the term il)Rn^i{z)4>. How- 
ever, we first need to show that 



1 



tr {Rn,l{z)Rn,l{zV) ^n.l 



converges in probability to a constant as n tends to infinity. We do so in the 
following lemma. 

Lemma 12. For any z,w £ D, 
1 



-tr (i?„(z)i?„(u;)T) lo„ 



zw — 1 



in probability as n ^ oo. The result also holds when R^ is replaced by R^.i and Jlj, 
is replaced by 
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Proof. We will prove the result for i?„ on the event fin- The proof for Rn,i follows 
the same argument. 

We define X„ :— -^Mn and recall that 

Qn - {Xn : \\Xn\\ < k} ■ 

By Lemma[71 the matrix Xn and the truncated version X„ coincide with probability 
going to one. Thus it suffices to prove Lemma[T2]for the truncated version. To avoid 
unnecessary notation, we let Xn denote the truncated matrix and Rn{z) denote the 
resolvent of the truncated matrix. 

Let D{z) = {z- Xn) and H{z,w) = [D{w)^ D{z)]-'^ . We will let dk{z) denote 
the fc-th column of D{z) and Dk{z) denote the matrix D(z) with the fc-th column 
removed. Then we have that 



—tTH{z,w)ln„ 
n 



1 



n— 1 

iy 

n ^ dk{w)'^ dk{z) - dk{w)'^ Dk{z)Hk{z,w)Dk{w)'^ dk{z) 
n fr{ dk{wYdk{z) - dk(wy^ Du{z)Hk{z,'w)Dk{wy dk{z)ln^ 

^ 1 

n ^-^ 

k=l 

where Hk{z,w) = [Dk{w)^ Dk{z)]^^ and 13^:^ ^ dk{w)^dk{z)-dk{w)^Dk{z)Hk{z,w)Dk{w)^dk{z)ln^ 

(k) 

Let Tk denote the fc-th column of Xn and let Xn denote the matrix Xn with 
the fc-th column removed. On the event r2„, we have that < k and hence 



\\H{z,w)\\ < IC^ 



and s\ip\\Hk(z,w)\\ < JC 

k 



We also note that 

dk{w)^dk{z) = zw-{z + w)Xnkk + "rlrk- 
Recalling that the entries of Xn (and hence Vk ) have variance i , we have that 



sup \dk{w) dk(z) ~ (zw + l)\ > t 

l<fc<n-l 



n-1 

k=l 
n-1 

k=l 



Xn 



kk 



> 



2|z| + 2|w| 



T 

fk 



{2\z\ + 2\w\Ymi 



\rlrk-l\' 



= 0{€r. 



by Lemma [TUl 
Define the event 



1]W = {||X„||:||X«||<^} 



Below we will make use of the fact that lo. 
We note that 

\T 7-i_ r \ Tj /„,.^T 



dk{w) Dk{z)Hk{z,w)Dk{w) dk{z) 

= r'^Dk{z)Hk{z,w)Dk{wfrk~welDk{z)Hk{z,w)Dk{wfrk 

- zrl Dk[z)Hk{z,w)Dk[w)^ ek + zwej Dkiz)Hk{z,w)Dk{w)'^ ek- 
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Since \\Dk{z)Hk{z,w)Dk{w)^ dk{z)\\lnr, < k^/C^ by Lemma ITOl and Markov's 
inequality, we have that 



( sup ^\r^Dk{z)Hk{z,w)Dk{wfrk - ^Tr{Dk{z)Hk{z,w)Dk{wf)\lnr. > 

sup \rjDk{z)Hk{z,w)Dk{wfrk - -TiiDk{z)Hkiz,w)Dk{wf)\l^w > 



\l<k<n-l 
< 



a<fc<n-i 
0(e„), 



sup \elDkiz)Hkiz,w)Dkiwfrk\ln,, > e] = o(- 



l<fe<n-l 



sup \r;^Dkiz)Hkiz,w)Dk{w)''ek\ln„ > e ) = O ( - 



a<fe<n-i 
Furthermore, 

-TT{Dk{z)Hk{z,w)Dkiwf) = ^ = l + o(- 
n n \n 

Therefore, the above estimates imply that 

sup |/3fe - zw + zwejDk{z)Hk{z, w)Dk{w)^ ek\ln„ 

l<fe<n-l 







in probability as n -> cx). 

Let Uk denote the k-th row of Xn with the fc-th entry removed. Then 

ejDkiz)Hkiz,w)Dk{w)^ek = y]:Hk{z,w)yk. 

Let Hk{z,w) = [Dk{w)'^ Dk{z)]~^ where Dk{z) is the matrix Dk{z) with the fc-th 
row removed. Since Hk{z, w)~^ = Hk{z, w)~^ + ykUk : by the resolvent identity 

yjHk{z,w)yk = 1 



1 + y'^Hk{z,w)yk 



Since for any 1 < fc < n — 1 

1 



ylHk{z,w)y 



\H{z,w)kk\ln^ <K.\ 



it follows that 



sup 

l<fc<n-l 

in probability as n — )> c». 
Now define the event 



J_ _ 1 + yjHk{z,w)yk 
I3k 



zw 



~ (k) 

where Xn is the matrix Xn with the fc-th column and fc-th row removed. Again we 
will make use of the fact that lo„ < l^-^c^) . In particular, using Markov's inequality 
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and Lemma [TOl it follows that 



sup 

l<k<n-l 



ykHk(z,w)yk - -ti{Hk{z,w)) 



< sup 

l<k<n~l 



ykHk(z,w)yk ii{Hk{z,w)) 

n 



in probability as n — ^ oo. 

Finally, let Sk{z, w) = [{w — Xk)'^ {z — Xk)]~^ where is the matrix Xn where 
the A;-th row and fc-th column are replaced by zeros. In particular, Sk{z,w) is an 
n X n matrix. It follows that 



trS'fe(z, w) — tvHkiz, w) 



O 



Then by the resolvent identity, for 1 < /c < n — 1 , 



—trSk{z,w) H{z,w) 

n n 



1 

= -tr 

n 

4 



H{z, w){iw- Xn) ' (z - Xn) - {w - X k) ' (z - Xk) ) Sk{z, w) 



n 



< -\\Hiz, W)[{W- Xn) '{z-Xn)-{w-Xk)'iz~Xk)) w)\\ln^ 



< -JCWz\ + k){\w\+k) 
n 



since {w — X„)'^(z — Xn) — {w — Xk)'^{z — Xk) is at most rank 4. Therefore, we 
have that 



sup 

l<fc<n-l 



—trHk(z,ui) H(z,w) 

n n 



oil 

n 



Therefore, combining the above, yields that 



sup 

l<fc<n-l 



J_ _ l + ^trg(2,u;) 
Pk 



zw 



in probability as n — > oo and hence 



1 , , 1 + -tTH(z,w) 

-tYH{z,w)ln,, 2 ^^lo„ — ^ 

n zw 

in probability as n — )■ oo. The proof of the lemma is complete. 



□ 
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By Lemma nil we have that 



1 

-tr 

n 



1 

-tr 

n 



1 

-tr 

n 



Rn,liz) , Rn.l{z) \ / Rn,l{w) i?„,/(w) 



2z2 

1 

^ 4 



2z2 
1 



2U)2 



z2k;2(zw — 1) 2;2w2(2;w — 1) z ^^(zu' — 1) z w {zw — l) 



Rn,l{z) Rn.l{z) \ / Rn,l{w) Rn,l{w) 



-lz2 
1 



V2 



1 



2^/^^(72 2V^w2 
1 



1 



1 



z2l(;2(2:W— 1) z2w2(zw— 1) ZW^{zW—l) Zw{zW—l) 

T 



Rn,l{z) Rn,l{z) \ ( Rn,l{w) Rn,l{w) 



2z2 



2z2 



2y/^W^ 2^f^V? ^ 

1 



Z2w2(2;t« — 1) z'^w'^{zw —\) Z^w'^{zW~l) Z^ w"^ {zW — 1) _ 

in probability as n — >■ oo. 

Fix r > 1, pick zi, . . . , Zr,wi, . . . ,Wr € D, and let ak, Pk G K for 1 < A: < r. 
Then define the matrix 



fc=i 



Rnd{zk) , Rn,l{zk) 



2zk^ 



Pk 



Rn,l{wk) Rn,l{wk) 



2V^wl 2 



IWk^ 



Clearly ip, (j), and Q are independent. By applying Lemma [HI from Appendix \K\ 
to the term 

and using the calculations above from Lemma [121 it follows that the finite dimen- 
sional distributions of S'„(z) converge to S{z). 



4. Tightness 

We now extend the finite dimensional convergence of 5„(z) to weak convergence 
in the space of continuous functions by verifying that {5'„}„>i is tight in the space 
of continuous functions on D (see for example [8]). Since 5'„(z) is expressed as a 
linear combination of y„(z)ij, 1 < i,j < I, it suffices to show that {||5^ra||}n>i is 
tight in the space of continuous functions on D. 

We remind the reader that 



Yn{z) 



-.Mr. 



Since D is compact, there exists some constant C(D) > such that 
(8) 2 + e < |z| < (7(1?) for all z e 

By Proposition [TTl 

^sup||r„(z)||lg^ >rj] <pfsup||i?„(z)|l >/c) +P(loc)- 
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as n — >■ oo. The problem then reduces to showing that {||i^n||lo„}n>i is tight in 
the space of continuous functions on D. We will verify the Arzela-Ascoli criteria 
(0) by checking that there exists constants a, /3, C > such that 

E|||y„(z)||if^„ - ||r„H||io„r < c|2 - 

for all z,w E D and all n > 1. 

Lemma 13. There exists a constant C > (depending on the set D) such that 

E||iK„(z)||lo„ - \\Y,,{w)\\lnS < C\z - 
for all z,w E D and all n > 1. 

Proof. Define the I x I matrix 

1 . 



Rniz)i 



By the triangle inequality, 

|||r„(z)||lo„ - ||r„H||loJ < \\Yniz)-Yniw)\\ln„ 

(9) <V^\\Qn{z)-Qn{w)\\ln„ + 

We start by bounding the second term on the right-hand side of For z,w € 



X 


X 


^2 " 





\X\ 



\x\ 



z^ 

We then apply the naive bound 



AC{Df\w-z\' 



(10) 

to obtain 



E\\Xf < EtT{XX*) = E\mr, 



E 



\X\ 



\X\ 



for some constant C > (which depends on the set D). 

In order to deal with the first term on the right-hand side of ([9]) , we decompose 
I / / 1 1 \ -1 



Rn{z) 



2J ^ Otj 



= Vn \ \ z —X tpRnjiz) 



1 



^X - -i/jR,u{z) 
Jn n 



1 



X+^^Rn.l{z) 

Jn 



Tn{z) {X + ^ijRn,i{z 



by the resolvent identity, where 

T„(z) = f z - -^X - -i>R^^i{z) 
\ ^Jn n 

We note that all the relevant inverses above exist on the event r2„. Then 



V^WQniz) ~ Qniw)\\ < 



— Tn{w) - —Tn{z) 
W Z 



Tn{w) 



IpRndiw) 



Tn{z) 
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On the event f2„, we have that 

<ii^ii (r„Mii 



— T„(w) - — T„(z) 
w z 



1 1 

w z 



+ ^||r„H-r„(z)|| 



<ll^ll 



|z-u;| + ||T„H-r„(z)|l 



and by the resolvent identity 

(11) \\T^{w) ^ Tr,{z)\\ < }e\z - w\. 

Thus by (flO)) . we obtain that 



E 



— Tn[w) r„(z) 

W Z 



Similarly, we now bound 



Tn(z) 

ilRn,l{w)4) '^!-^tpRn,l(f> 

Wy/n Zy/n 
Using the triangle inequality and pT|) . it suffices to bound 

1 



-E||V'i?„,;(2)</)|rin„ 
n 



(12) 
and 
(13) 

For dn]), we note that 

-E\\ijRr,,iiz)^W'ln„ < -E||^i?„/z 



-E||V'[i?,M(-2)-^n.i(w)] '^fln.- 
n 



1 ' 



ij = l 

by Lemma [HI 

For (|13p . we apply the resolvent identity and obtain 



-E 11^ [i?„,z(z) - i?„.i(?«)] 011' lo„ <-\z- w\^E ||^i?„/z)i?„,,(u;)(^||' 1^, 
n n 

<-\z- wfE \\ijRn.i{z)RnAw)(f>f 
n 

Since ipRn,i{z)Rn,i{w)(j) is an Z x Z matrix, we again apply Lemma [HI to each entry 
to bound the norm and obtain 

^E ||Vi?„,i(^)i?„,i(w')0f lo„,, < I^IC^ 



Therefore 



E 



IpRnjiw) 



Tn{z) 



Wy'n Zy'n 

and the proof of the lemma is complete. 



'4'Rn,l4> 



ln„ < C\z-w\^ 



□ 
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Appendix A. Central Limit Theorem 



Lemma [Ml below is a Corollary of Theorem A. 5 from \19\. The version presented 
here is for truncated random variables. 

Lemma 14. Let {B" : 1 < s < r} be a family of n x n real random matrices. Let 
{:iCn\yn'^ : 1 < s < r} be a collection of independent n-vectors with independent 
real standardized entries where yn'' = {ynj)i<j<n, ^n"^ — {^nj)i<j<n, o,nd 



(Hi) there exists a constant a (not depending on n) such that maxKsKr \\B'^\\ < a, 
(iv) for each l<s<r,Hv {{B')* B'') converges in probability to a number a2(s). 

Then the random r-vector 



converges in distribution as n oo to an r-vector Z = {zs)i<s<r whose entries are 
independent normal random variables with mean zero and where the variance of Zs 
is 02(5). 
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